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A study wac^ designed tc investigate forms of human 
internal knowledge organization that facilitate the recall of 
information or its use for conplex prcblem solving tasks. Thr*^e 
experiments^ using college and high school physics students^ were 
performed. The effects were studied ty : (1)" formulating explicit 
models of organization; (2) using extersive treatments to induce 
subjects to acquire specified organization; and (3) testing subjects' 
subsequent performance on recall and problero-solving tasks. A 
prescriptive model of hierarchical organiza tion ^ was specified^ 
designed to facilitate selective information retrieval^ constructed 
by successive elaborations of a few tcp-level ideas most important 
for a specified task domain. Subjects with such a hierarchical 
organiza ti Oil performed appreciably better compared tc subjects with a 
single^level organization of the same knowledge. Subjects also 
performed better on those tasks involving information included at 
higher levels of the subjects' internal hierarchical organization. In 
general^ subjects of higher ability seemed better able to assimilate 
and exploit hierarchical organization. Various observations indicated 
that training methods used were quite effective in inducing a 
specified internal knowledge organization. (Author/MH) 
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jBSTRACT 

The effects of nan im- :1 knowledge organizatfon were studied 
by (1) forralatlng ex^' in: ^m£z if organnatlon, (2) ming emnsive 
treatments to Induce i:!)je:ti to acquire smclfled organizations, and 
(3) testlnj) subjects' aitceqwc pert^inmnce on recall anri probta-sol-Mig 
tasks. In particular, it vBErfied a prwcriptlve model # liierwchical 
organization, designed ™-^ctTiitatfi sele :lve Inforaati -strieval, 
constructed by succssive "'' (l^ntlons o' * top-)cvf ' <ms mt 
important for a sperrfle, ' s min. [ experf^st-: -jbjects with 
such a hierarchical Drg»ntfatii, EsKcrmp. .juimeciably f:8»t5«; cowared '.o 
subjects with a sli anpiiaatior »r % same ksjJ'ledfc. te 
expected, subjects tvrfm'^ better u-n 'jme tasks' inv#;1ng iitfor- 
^atlon included at iii^r 3f the subj. ' fnter-ij ii8rarcf*ral 
ganlzation. In ^a^r, Hg(,g^ uElity:? rrwi better ;ble 

' ' assimilate and ex«l»i'. -.-.r-j, a' Tqani22tton. lFf»^^ obserr^iiioTR 
if!#^»fid that our tri^i* .;^,oq^ wereiiuite effectiw i- inducinc a 
'I ed internal knc iianizatlon. 
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3. 

INTRODUCTION 

TlR?oretical considerations and e^)lrlcal data both sug^pst thrt the 
organlrrtion of a person's knoyiledge affects crucially M>s oriir ability 
to use knowledge effectively. Accordingly, the stai^- deseribetf In 
this papr was specifically designed to Investigate fons of haen kfww- 
ledge or^i^niizatlon that facilitate the recall of Infonnatt^on r its use 
for reall 'tically complex probleni-solvlng tasks. 

A OTdy of iWs kind Is clearly relevant to basic TOearcn on hipan 
lirformatrtm prtjcwsing. Moreover, because of Its etnphas^ on information- 
processing wdels deigned to Inprm hunan performance^ such work Is also 
directly gpii*%m to practical Instruction. 

Our Mor^ deals with coinplex Medge and tssks representative of 
practical gtarnional or scientific conwrns Previous studies of certain 
organ1zat1%ii mts of human knowledft \m been described by Kintsch 
and Keenan ilWi,.Heyer (1975), Ausub? (1558), Sliavelsp (1972, 1974). 
Hayer and te-w 1972), Postman (1972). .and others. 

The \mz. presupposition of our wwA ts that the ofeervable and 
diverse lnti*«ffll performance of pewow can be explained economically 
In terms of owturitid properties of the 'Eternal knowledge" Inside a 
person's mine. Thir. theoretical stance 1«ids one to formulate models of 
speclfte fomcrof imternal knowledge. Inciting prescriptive models de- 
signed to enhance hnn performance on cerain Intellectual tasks. Con- 
trolled experiments mi detailed observattms are then used to test 
particular features fff these models and to suggest revisions In them. 

In the follow^ pages we first discuss the theoretical construct 
of bwian "Internal hwledge" and then tecrlbe a model specifying a 
hierarchical knowle^qe organization expeirted to facilitate complex 



information-retrieval tasks, Next we point out some research questions 
suggested by the model and propose an experimental approach for studying 
these questions. Then we report on three specific experiments designed 
(1) to examine the effectiveness of such a hierarchical knowledge organi- 
zation compared to a single-level organization, (2) to study the appro- 
priate matching of a hierarchical organization to the Intended task 
domain, and (3) to assess the efficacy of our experimental niethods for 
inducing human subjects to acquire specified forms of Internal knowledge 
organization, Finally, we discuss some Implications of this vfork for 
research on human information processing and for practical educational 
applications. 

BASIC ISSUES AND HETHODS 

A person's 'internal knowledge" Is a theoretical construct useful 
to the extent that It allows one to relate and predict a wide range of 
directly observable phenomena. Conversely, the properties of such Inter- 
nal knowledge are ultimately deduced from mutually consistent inferences 
derived from observable phenomena, 

The postulated Internal knowledge of a person can be characterized 
by the content of Its information, by Its organization, and by its sym- 
bolic representation. In addition, the internal knoHedge includes pro- 
cedures for acting on the preceding Information (e.g., procedures for 
retrieving data efficiently f™ a given organization of Information, or 
procedures for reorganizing Information Into more useful fonns). As men- 
tioned previously, our study focus-is Its attention specifically on the 
organization of sych Internal knowledge. 
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By using thf ttifsDretlcal rm.. t # internal knowledge, a person's 
infanwtion-processfng behavirr m bi m-iH^ \m ttiree subprocesses: 
(1) Input processes thereby oiwililitilo u lutwtlon outside the person Is 
transfonned into internal knoMa)!?, Internal processes (not directly 
observable) whereby such Inteiw^f knowledemy be further transformed, 
(3) Output processEs thereby fUj Mmi) aaMiaige i3 transfotuied Into 
the person's behavior observaliiJe v oumule «rld. (These input and 
output processes are jsually 1 , M seoKrtlal, Hitile the postulated 
internal knowledge is some corar' «il:idlBBisionai structure.) 

There are then tw analyt 1,^ ijnBBDie questions which can be 
asked about internal knowldge - irgamiation) and directly ob- 
servable processes: (1) Htet tt (ie reldtl« between input processes 
and the resulting organizatcicr ft loritenial kmowledge? (2) What is the ' 
relation between the organiza*' ,. ■ Mtrrnl knowledge and the resulting 
output processes? 

In the present study we art jjHwr' interested in the second (or 
"output") question. In othtf^ irtrj, . or cttitral aim is to study the 
effects of ajven forms of in. iwlfd9e organization on the perfor- 
mance of various recall and y xlnij- tasks. Thus we are only 
secondarily Interested In In- processes whereby a given 

internal knowledge organizatw ■ l""Miy aci^uired. 

The preceding eiphasis 1??^ f);Ht nf decomposing a complex 
problem into two distinct quest , ► ' ich ikay be stiatied separately in 
greater detail, furthermore ,r siuuy of useful internal knowledge 
organizations should facilitc equent efforts to study or prorrote the 
acquisition of practically u n « of internal knowledge organization. 
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itJDieve our nf saidying the effects a given internal 
;noNlM9e wgarizatf- • adopted the following approach: (I ) ForuiulatF 

one Bodeflf. of in^ fledge organization, including a prescripaiiw- 
*del desMwd tc fc^ :ate Dotimally human perfotrance on certain lasks. 

;) C-rate omilrorefliisijirinental conditions to asstEre that a human ;bI>- 
iect 2cquire-:£ -ir. '(mmi internal knowledge or^anizmon. (3) PerfroiF 
^ lerimental ustj a how well such a subject performs on vanous 

Ey di«i ng Tiis '<«niBktive approach, we hoped to gain the imn- 
h*g?of stdylittg ps tliiiiirfatures of a model under controlled condi- 
UTnt. Fr 'M- lore ^ ' iiped that the prescriptive aspects of this 
apD-PMCh rjiuiff yie^j n jgls and procedures of potential relevance to 
eat- :tiorfii ap Mcinms, 

Theii«cliii|( iinKjflweitation of such a manipulative approach (somewhat 
akai to W3rr „ artifiti/ intelligence) is clearly more difficult in the 
Gsof a m-. infontetton processor than of a computer. In particular, 
it -:s iinpC'iilbie to na,.,,julate or observe directly human internal know- 
fed^. FurtHerarre, t: focus on internal organization requires one tc 
ssf.,i£ate iti affects from those of other aspects of internal knowledge, 
4t sAall df^^k lai-r the specific experimental methods whereby we soqht 
Iq i^inimije '1e.2 diff-curties. 



HIERilRCHICflL TflSK-flDAPTED KNOWLEDGE ORGAfllZATIQH 
if a jerson 's to use a substantial amount of internal knowledge rar 
-j»i(^ng Hexibly a variety of tasks, this knowledge must be effectively 
K. -zed t- facilitate the selective retrieval of any particular inforwfewn 
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Hence It H of inte»Bti n ^'onmlate a (n-escrrDtlve inodel wplicUly de- 
signed to fac1lltate:eM!r!!^r1eval. 

An efficient retrnwii process can be adileved by using a "top-down" 
procedure 3f successte-^-naaests to narrw^ domain of search In 
geonetrically pro^ressw fashion. This Is ffOTnpHshed by decomposing 
the retrieval process riwarchicflly Into sue :i5slve steps each of which 
Involves decisions abac wly a few rajor aitenatlves, In such a way that 
decisions at earlier stHit; facilitate nore dasiled decisions at later 
steps. 

Evidence from severol donains suggestive utility of a hierarchical 
organization for Infonanicn-processlng taski. Such evidence comes from 
psychological studies on hierarchical organization and recall (KIntsch 
J Keenan, 1972; Heyer, 1975), from writ In artificial intelligence 
(Sacerdoti, 1977), fraii studies on human profcleiti' solving in physics 
(Larkin, 1978; Larltin S Reif, 1979), and fm recent developments In com- 
puter prograniiing (Hughes S Hlchton, 1977). 

The previous coflSl(teration5 led us to formulate the following sped- 
fic features of a prescriptive model of buiian knowledge organization 
designed to facilitate selective Inforwtlon retrieval 

(1) Hierarchical structure : The l:now«dge is subdivided into know- 
ledge units related in such a way that a few information Items in any unit 
are elaborated by further description through "subordinate" knowledge 
units. The result of such successive elaborations Is a multi-level de- 
scription hierarchically orpired In tne fashion Illustrated In Fig. 1. 
Explicit cross-references or "pointers" help to link subordinate units to 
superordlnate ones. In addition, there are some pointers providing con- 
nections to help retrieve inforaatlon "laterally" (i.e., not merely along 
superordlriatc-subordinate connections). 




Flj.J; Schematic diagram of a hierarchical knowledge organization. 



(2) Adaptation to task domain : To adapt the preceding hierarchical 
linoMledge organization to the domain of tasks for which this knowledge 

is to be used, superordinate knowledge units Incorporate Information more 
"important" for the task domain than subordinate units. (The information 
ranked as most important is that which is most frequently used for tasks 
in tlie domain, or which is most useful for retrieving other information 
most frequently used.) In this way, the total nimber of steps in a top- 
down retrieval process can usually be kept small. 

(3) Adaptation to human capabilities : The knowledge organization 
of Fig. 1 is adapted to the limited processing and short-term memory 
capacities of human subjects, Hence the amount of information in each 
knowledge unit is kept small enough to be easily processed, but large 
enough to keep the total number of knowledge units small. Furthermore, 
each knowledge unit is only elaborated into a few (<5) subordinate units 
(so that only very few alternatives need be considered at any decision 
step of a retrieval process). 

Theoretically we expect that knowledge organized in the hierarchical 
task-adapted fashion just described, when used in conjunction with a top- 
down retrieval procedure, should facilitate efficient flexible performance 
of many tasks. In particular, we expect that recall of inforiMtion should 
be facilitated because high-level infomation in a few superordinate know- 
ledge units facilitates the ret/ieval of more extensive detailed informa- 
tion in subordinate knowledge units. He also expect that various problem- 
solving tasks should be facilitated. For example, finding a mistake 
("debugging") should be facilitated because one can more easily isolate 
one of the few superordinate knowledge units affected by a niistake^and can 
then trace down successively to find the specific locus of the mistake. 

ERIC 
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Similarly, a task of modification or generalization sliould be facilitated 
because one can quickly identify which superordinate knowledge units are 
affected or left invariant, and can then readily make more detailed modi- 
fications in the affected unit. 

RESEARCH QUESTIONS AND EKPERIHEHTAL APPROACH 
QUESTIONS FOR INVESTIGATION 

The preceding theoretical model suggests the following specific 
questions for experimental investigation: 

(1) How effective is an internal hierarchical knowledge organiza- 
tion (of the kind described in the preceding paragraphs) for facilitating 
perforf,idnce on various recall and problem-solving tasks? In particular, 
we shall try to answer experimentally the following questions: (a) Is a 
hierarchical organization more effective than a single-level organization? 
(b) Is a hierarchical organization indeed mure useful for those tasks 
which match infonnation in its higher levels, than for those tasks which 
match Information at its lower levels? 

(2) How effectively can one induce hunan subjects to acquire a 
specified fonii of internal knowledge? In particular, we shall try to 
answer the following questions: (a) Hhat are some methods for inducing 
a desired form of internal knowledge organization? (b) What evidence 
can be provided to ascertain the nature of such an internal organization? 

This second iiiajor question is important because our method for 
studying the effects of internal knowledge organization is predicated on 
the assumption that we can induce a specified organization in himan 
experimental subjects. More generally, this question may also help to 
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reveal to what extent It is jwsslble, for either research or educational 
purposes, tu deliberately Influence a person's Internal knowledge. 

EXrERlHENTAL APPROACH 

The following section' describe three specific experiments designed 
to answer jointly the preceding questions. Experiment 1 addresses pri- 
marily question la about the comparative effectiveness of a hierarchical 
and a single-level organization. Experiment 2 addresses primarily ques- 
tion lb about the importance of appropriately matching a hierarchical 
organization to the intended task domain. Both of these experiments also 
yield some inroniiatlon about question 2 concerning the acquisition of In- 
ternal organization. However, experiment 3 is especially designed to 
explore this latter question. 

To carry out these experiments. It was necessary to devise mthods 
which can overcome or minimize the following difficulties Involved in 
studying human internal knowledge, 

(1) it is impossible to manipulate directly internal knowledge 
or its organization . To minimize this difficulty In the face of possible 
previously existing internal knowledge, we used "strong" Irput treatments 
which maximally structured the acquisition process to assure that a sub- 
ject acquire information in a specified form. This was done by using In- 
fonnatlon unfamiliar to the subject, by carefully controlling the form 
of the iRfotwtion presented to the subject, by ssgdging the subject in 
special processing tasks designed to reenforce the acquisition of a speci- 
fied fon of knowledge, and by Uniting opportunities for Internal reor- 
ganization of this acquired knowledge. 

ERIC 
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{2) It Is iMsslble t o obs erve directly wliether^a jartl^^^^^^^^^ 
temal kn owledge organization exi sts or has been acqu ired. To minimize 
this difficulty, we monitored thr subject's performance on some sppclal 
tasks which collectively allowed inferences about the nature of the sub- 
ject's Internal knowledge organization. This fnonltorlng included (a) some 
"acquisition tasks" given during the Instruction to assure that the de- 
sired organization was being Incorporated; (b) observations of some 
qualitative differences In performance on the final testing tasks; and 
(c) detailed analysis of some subjects' recJl protocols. 

(3) For purposes of our stu d y, the effects of Internal orga niza- 
tion must be separated from those of other aspects of internal knowledge. 
To achieve this aim, the content and symbolic representation of the know- 
ledge acquired by subjects was kept constant throughout an experiment. 
Furthermore, the experiments tried to assure that subjects use their 
internal knowledge with a particular retrieval process. This was done 
by presenting the Input Infonnatlon in a way exhibiting such a process, 
and by monitoring Indirectly whether subjects themselves actually used 
this process* 

The preceding considerations were embodied In an experimental pro* 
cedure which Involved the following main steps; (1) Choose a particular 
knowledge domain and a particular set of recall and problem-solving tasks 
to which this knowledge is applied. (2) Specify alternative organizations 
of this knowledge (including a hierarchical organization according to the 
prescriptive model). (3) Use strong Input procedures to assure that 
different subjects acquire the specified alternative forms of internal 
knowledge organization. (4) Test the performance of the subjects on a 
conwon set of tasks, 

13 
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EXPERIHENT 1 



Experiment 1 addressed the following question; Is a hierarchical 
Internal knowledge organization Indeed more effective than a single-level 
organization for performing various recall and problen-solving tasks? 

DESIGN 

To achieve such a comparison, the experiment used treatments whereby 
subjects would acquire either a hierarchical or a single-level organiza- 
tion. The particular design Involved three groups of subjects who were 
exposed to the three treatments illustrated In Fig. 2. The "H-treatment" 
presented a hierarchical organization of some Knowledge; the '5j - treai-. 
ment" presented a single-level organization of the same knowledge; and 
the "S^ - treatment" presented this single-level organization twice in 
succession. (This last treatment was merely used to compare a single 
presentatlon^of an essentially two-level hierarchical organlzatlonjWith 
two presentations of a single-level organization,) Each treatment In- 
volved appropriately organized materials^ as well as acquisition tasks 
designed to assure the Incorporation of the specified organization, After 
these various treatments, all subjects were given the same performifnce 
test. 

The subjects participating In the experiment were 36 paid volunteers 
recruited among students in an Introductory college-level physics course. 
These subjects were subdivided into three blocks of different ability 
(high, medium, and low) determined by the subjects' performance on a 
prior physics test In their course. The subjects in each ability block 
were then randomly assigned to three groups which were then randomly 
assigned to the three treatments. Thus each treatment included 12 subjects, 
' ability level. 
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13. 

METHOD 

Knowladqe domajn a nd tasks 

The knowledge selected for this experiment consisted of an argument 
using given premises to derive a desired result. The argument, taken 
from the field of physics, was typical of similar arguments cnmnionly en- 
ccjntered in other college-level science courses. It involved a deriva- 
tion using pliysics principles and algebraic operations to express a de- 
sired quantity in terms of measurable quantities. 

A Itnowledge of this kind of argument can be used to carry out 
various recall and problem-solving tasks. <!uch tasks were then Included 
It) the prrfomiance test described later. 

Alternative orga nizations and materials 

The srgunient was organized 1n a hierarchical or single-level fonn, 
each described In a written version of materials. In the hierarchical 
or i!-verslon, the arguient was organized hierarchically at several levels. 
The first or highest level consisted mainly of a statement describing the 
purpose of the argument and the quantities to be related by It. The 
second level provided an overview expressing the argument In teniis of 
four major steps (e.g., "find the gravitational acceleration g from the 
Initial mtlon by using the general relation h •- j gt^"). The third level 
consisted of the complete argimient dticrlbed In terms of a sequence of 
detailed mathematical steps. 

Several means were used tn inake the hierarchical stnjcture explicit 
within the constraints of a linear prose presentation. For example, the 
presentation traversed the hierarchy systematically in a top-down fashion 
(from level 1 to level 3). It emphasized the underlying structure by 

ia 
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graphical aids such as titles and suiWtles, Indentations, etc, It ex- 
plicitly pointed out what parts of ttie argtment were elaborations of 
steps encountered at higher levels, And it made connections between 
levels apparent by using titles referring back to the preceding higher 
level. 

The S-verslon of the materials, designed to approximate a single- 
level organization of the argument, differed from the H-verslon by omit- 
ting the second "overview" level, while retaining the third level (with 
the same wording, but without the Interspersed titles connecting this 
level back to the higher second level). The top first level was also 
retained. Thw the S version designed to simulate closely a good 
conventional class-room presentation which states the basic goal of an 
argument and then launches directly Into a logically tight detailed 
argument. i 

Treatments , 

The treatments using the preceding materials are Illustrated In 
Fig. 2. (Each of these treatments lasted about an hour.) In the . 
H-treatment, the subjects first read levels 1 and 2 of the presentation. 
Then they perfomied some "high-level" written acquisition tasks designed 
to assure the acquisition of Information at levels I and 2. (These tasks 
asked subjects questions about the purpose of the argument, about major 
steps needed In the argument, or about the function of some of these 
major steps.) Then subjects read through level 3 of the argument. 
Finally, they perfonned some "low-level" ..itfen acquisition tfisks de- 
signed to assure that a subject had the "Iocs?" knowledge necessary to 
interpret every individual detailed step of tiR argument (e.g., to apply 
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such a step to specific numerical examples). 

In the Sj-treatment, the subjects read the S-version once and then 
did the previously described low-level acquisition tasks. In the S^- 
treatinent, the subjects read the S-version twice before doing these 
loM-levei acquisition tasks. 

After doing either the high or low-level acquisition tasks, the 
subjects were given the correct answers and were then asked to redo any 
questions which they had failed to answer correctly. This procedure was 
repeated until the subjects could answer all questions correctly. Thus 
the acquisition tasks served to monitor that specified aspects of the 
knowledss ki, in hit, fcess issLniUted. 

To minlniize chances of internal reorganization of acquired knowledge, 
subjects were not allowed to take any notes, were allowed to read through 
the versions only the prescribed number of times, and were not given any 
excess time beyond that required for such reading. 

Perfomiance tests 

After a subject had completed the preceding tr«atiiient, he or she 
relinquished the instructional materials and was given a test consisting 
of several performance tasks. These tasks were given in an order likely 
to nlniinize undesirable interaction between tasks (e.g., recall tasks 
were given before problem-solving tasks that might cue such recall). 

Five of the tasks tested were "complex" in the sense that each of 
them required infomation about several parts of the argument. (Such 
tasks were thus expected to be facilitated by the hierarchical organiza- 
tion which provided higher-level connections between detailed steps of 
the argument.) These tasks included free recall (reproducing the entire 
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argument unaided); cued recall (e.9,, given a certain part of the 
argument, what is the next step in the argument?); "debugging" (e.g., 
diagnosing the effects of a mistake in a similar argument); a-id two modi- 
fication tasks (carrying out a similar argument with changed premises). 

A few other tasks were "local", i.e., they relied only on informa- 
tion about individual detailed steps of the argument (and involved thus 
questions similar to those used in the low-level acquisition tasks). 

Finally, some additional test tasks, described later, were designed 
to probe the subjects' internal knowledge organization. 

nrciii TP 

hL JULIO 

Performance on "complex" and "local" tasks 

Fig. 3 shows, for each of the three treatments, the mn scores of 
the subjects on each of the five "complex" tasks described above. Con- 
sistently, subjects in the H-treatment performed better than subjects 
in the S^-treatment, who performed better than (or equivalents to) 
subjects in the Sj-treatment. For each subject, the scores on all these 
tasks can be combined into a composite score for complex tasks. The 
mean value of this score, averaged for each treatment, is also shown in 
Fig- 3. A tw-way analysis of variance (treatment x ability), perfomed 
on the composite scores for complex tasks, shows statistically signifi- 
cant effects of the three diffsrelit trsjtiKnts [r(2,2;) - 10.34, 
p < 0.001] as well is of the subjects' three different ability levels 
(F(2,27) " 8,5r, p < o.OiJ. More specifically, a-priori one-tail t-test$, 
comparing pairs of treatments on these scores, show that subjects in the 
ll-treatment performed significantly better on the complex tasks than 
subjects in the S^-treatraent jt = 2.fiB, df = 27, p < o.Olj, and that 

19 
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Fig. 3 : Scores on various test tasks performed by subjects receiviTig S,, 



$2^ and H treatments in experiment 1. (S.D. » standard deviation.) 



subjects in the S^-treatment perfomed significantl) bettpr than subjects 
in the Sj-treatfflent (t = 1.96, df ' 27, p < 0.05], 

Fig. 3 also shows the mean composite scores on all thp "local" 
tasks. The application of t-tests Indicates that these scoi??s do not 
differ significantly between the different treatments. 

The praeding results thus confirm the expectation that a hier- 
archical organization should facilitate performance on copiplsx tasks 
involving appreciable infotmation retrieval, but not on tasks which are 
merely local . 

Evidence about internal knowledge organization 

ils previously mentioned, the last three test tasks were intended 
to provide some evidence about the nature of the subjects' Internal 
knoi^ledge organization. Two of these tasks probed for the existence of 
high-level information. (One of these tasks asked subjects to use only 
a few statements to s»rize the argument. The other task asked them 
to order a scrambled list of such smmary statements into a sequential 
description of the argument.) If the Sj and subjects did indeed 
acquire an internal knowledge structure which is merely locally connec- 
ted, they would be expected to have difficulty with these tasks. This 
was actually the case. Thus the H subjects were consistently found to 
perfon better than the S, subjects, who were better than the S, subjects. 

In the last test task, all subjects were given a high-Uvel over- 
view of the argument (the same overview as that contained in the (i-verslon) 
and were then asked to derive the complete detailed argument. Nearly all 
subjects could perfonn this task, with about m perfect perfomance for ' 
all subjects irrespective of treatment. This result contrasts strikingly 
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with the widely differing performances exhibited by differently treated 
subjects In the prior free-recall task where subjects had to recall ' 
the argutiient unaided (see Fig. 3). The fact that thi) loere provision of 
an externa] high-level description Intproved the performance of the Sj 
and subjects so markedly suggests that the Internal knowledge organiza- 
tion of these subjects lacked such a high-level description. 

Qualitative differences in the performance on the various recall 
tasks provided additional evidence about internal knowledge organization. 
An internal knowledge organization which is itierely locally connected 
would be expected to result in the recall of only detailed steps of the 
argument. On the other haiid, a hierarchical organization would be expec- 
ted to result in the spontaneous recall of some higher-level inforniation 
which would, in turn, facilitate the recall of greater amounts of de- 
tailed information. In fact» in the "cued'-recair task (cued by the ques- 
tlon "what is the next step in the argument" after a given step) al[ 12 H 
subjects answered the question, and 7 of them responded with a sequence 
of steps or an overview of such a sequence, By contrast, only 5 Sj 
subjects and 8 subjects responded to this question, and all of them 
gave as an answer an iwnedlate consecutive step of the argument. Further- 
more, of those subjects who recalled the first step of the argument in 
the "fre^reca]^• task, most H subjects (9 out of 11) could complete the 
argwiient; but very few of the Sj subjects (1 out of 8) or of the sub- 
jects (3 out of 10) could comjilete it. 

Individual differences 

As already mentioned, a two-way analysis of variance on the compo- 
site scores for the complex tasks showed a significant effect (p < 0.01) 
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of subjects^ ability, as measured by perfortnance in a physics class. 
Fig. 4 exhibits these individual differences in greater detail. Compari- 
son of the treatment groups^by Scheffe's method of a-posteriori contrasts, 
yields the following results for the scores on complex tasks; Among 
the high-ability subjects, there was no significant difference between 
the mean scores of the H and $2 subjects) but the combined mean score of 
these subjects was significantly higher (p < 0.01) than the mean score of 
the Sj subjects. Among the medium-ability subjects, there was no signifi- 
cant difference between the mean scores of the S| and subjects; but 
the mean score of the H subjects was significantly higher (p < 0.01) than 
the combined mean score of the and subjects. Among the low-ability 
subjects, there was no significant difference between any of the mean 
scores. 

These results suggest the following possible interpretation. The 
fact that the low-ability H subjects did not perform better than Sj or 

subjects may indicate that they either did not acquire the hierarchical 
organization, or did not have the ability to use it effectively. Similar- 
ly, the fact that two readings of the single-level organization were quite 
useful for high-ability S^ subjects, but not for low or medium-ability 
S^ subjects, may indicate that the high-ability S^ subjects possessed 
skills for effectively reorganizing information and exploited these 
skills in the second reading. 

The preceding results are consistent with those obtained by Hwr 
(1978) who found that higher-ability subjects are better at acquiring 
the organization of input information, and are also better able to recall 
and use such infontiation. 
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fj9j; Scores of subjects of different ability on test tasks In 
experiiDcnt 1. (Score differences less than about Z5 percent are statis- 
tically not significant.) 



The primary goal of experiment 2 was to assess the Importance of 
properly adapting a hierarchical Internal knowledge organization to a 
desired set of tasks. Accordingly, the experiment compared the relative 
effectiveness of two hierarchical organizations which contained the same 
knowledge, but were adapted to different tasks. 

In addition, the experiment sought to examine more closely the ac- 
quisition of Internal knowledge organization. It also compared the effec- 
tiveness of two different treatments for inducing a specified Internal 
' organization. 

DESIGN 

He chose a knowledge domain and specified two distinct types of 
tasks (type V and type T). He then constructed two hierarchical 
organizations of the same knowledge units: organization A adapted to the 
tasks of type a, and organization B adapted to the tasks of type b, (Thus 
organization A included in Its high levels information most important for 
tasks of type a, and in its lower levels infomation most important for 
tasks of type b. The reverse was true for organization B.) By means of 
treatments of the kind Indicated in Fig. 5, subjects were trained to 
internalize one of these alternative organizations. After two weeks (a 
time deemed long enough for subjects to forget superficial features of 
the mode of presentation), the subjects were then ieiwu uii uuiJi lypus 
of tasks (a and b). 

Each treatment included some written materials, either A or B 
version, presenting the knowledge in the corresponding organization. The 
treatment included also several acquisition tasks designed to assure the 
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Incorporation of the desired organization. In the "strong" treatments 
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and B^, the acquisition tasks were extensive (similar to those in 
experiment 1). To assess the adequacy of less extensive acquisition 
tasks used with the sane materials, the experiment included also two 
"weak" treatments fl^ and B^. The design of the experiment included thus 
two factors, i.e., different input versions (A and B) and different ac- 
quisition tasks (strong and weak). 

The subjects (20 students enrolled in an advanced high-school 
physics class) were assigned to five blocks of different ability (four 
subjects per block) on the basis of their grades in the physics class. 
The subjects in each block were then randomly assigned to the four dif- ' 
ferent treatments. 

mm 

KnoMledqe domain and tasks 

To provide realistically complex knowledge unfamiliar to the sub- 
jects, the linowledge used in the experiment described a fictitious uni- 
verse of nuclear particles, but simulated the actual physical world, The 
knowledge thus included fictitious experimental observations, fictitious 
theoretical models explaining these observations, and a fictitious 
history of the development of theoretical concepts and experimental 
observations. 

The tasks for which this knowledge can be used consist of recall 
and problem-solving tasks which are either of type a ("deductive") or of 
type b ("historical"). Such tasks were included in a performance test 
described later, 
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ftlternaUve organisations and materials 

The preceding fictitious Medge was organized in two alternative 
hierarchical ways. Each organization included the same Itnowledge units, 
but the relationships between these units was different. These units 
Included "deductive" infomution about the assumptions and predictions 
of the most comprehensive physical model, and "historicar information 
about various periods of theoretical or experimental progress. In organi- 
zation A, adapted to the "deductive" or V tasks, the deductive informa- 
tion was placed in the higher levels of the hierarchy, while historical '. 
Infoimation was pi' In the lower levels of the hierarchy. Conversely, 
In organization B ..dapted to the "historical" or V taslts, the assign- 
ment of Infonnatlon to levels was reversed. 

To convey the hierarchical organization, each of the A or B versions 
of the materials presented the Information by systematically traversing 
the respective hierarchy top-down from higher to lower levels. In addi- 
tion, the versions emphasized the hierarchical organization by using 
titles at various levels, overviews, boxes surrounding important Informa- 
tion, organizational charts, and other aids. 

Treatments 

Each of the treatments. Illustrated In Fig. 5, lasted about 
90 minutes. Each subject read the previously described versions (either 
A or B) and performed various acquisition tasks. In the strong treat- 
ments Aj and B^, the following procedure was used: (I) After reading each 
of the four sections of the written version, the subject had to answer 
questions about the factual content of that section and to mark on an 
organizational chart the items that had been discussed in that section. 

o 
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(Z) After reading the entire written version, the subject pprformed the 
following two acquisition tasks: (a) A "content" task which asked ques- 
tions about various facts presented in the entire version, and which 
again asked the subject to mark his or her answers on an organizational 
chart, (b) An "organization" task in which the subject, when given in- 
dividual information items in random order, was asked to arrange them 
in an organizational chart (like that previously presented in the Instruc- 
tional materials). 

After each of the preceding acquisitiort tasks, the subject was given 
correct written answers and then had to repeat those tasks which were 
inadequately completed. This procedure was repeated until the subject 
could perform all the acquisition tasks correctly. 

[In the weak treatments and B^, the interspersed acquisition 
tasks were also used. However, instead of performing the second set of 
acquisition tasks, the subject was merely asked to write a summary of what 
he had read (with instructions to structure the sumry so that about five 
major ideas should be elaborated in turn).) 

Perfomnce tests 

At the end of the treatment, the subjects were told to return two 
weeks later to engage In similar activities. When the subjects returned, 
they were actually given a test (lasting about 90 minutes) consisting of 
various tasks performed in the following order: (1) A "free-recall" 
task in which the subject was asked to write a sumnary of the information 
he had read. (This stmmary was to be structured in the fora of about five 
major ideas which were then to be successively elaborated), (2) Several 
"cued-recall" tasks in which the subject was asked specific questions 
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requiring him or her to recall particular deductive or historical facts. 
(3) Some problem-solving tasks wtiich required the subject to nake some 
inferences on the basis of given facts. These problem-solving tasks were 
both "deductive" (e.g,, asking the subject to generalize the given 
theoretical niodel of nuclear particles to a slightly more complex situa* 
tion) and "historical" (e.g., asking the subject how a change in the 
sequence of experimental discoveries would have affected the fomlation 
of new theoretical concepts). 

RESULTS 

A di^piation of organization to tasks 

For each subject, a composite score was computed for all cued- 
recall and also for all problem-solving tasks of type a (deductive) and 
of type b (historical)^ Fig. 6 shows the means of these scores for 
subjects in the A and B treatments (both strong and weak). As predicted, 
subjects with the A organization performed consistently better on tasks 
of type a, while subjects with the B organization performed consistently 
better on tasks of type b. (Indeed, the individual scores on an^ one 
cued-recall or problem-solving task exhibit the same consistent pattern.) 

The observed differences can be exhibited more clearly by con- 
sidering for each subject a "difference score" C, - C, where C is the 

a 0/ a 

composite score for a]| a tasks and is the composite score for aH, 
b tasks. Fig. 6 also shows the means of these difference scores. An 
analysis of variance (input version x acquisition tasks, blocked by 
5 levels of ability) shows that this difference score depends signifi- 
cantly on the input version A or B (F(l,12) « 6.45, p < 0.03], but not 
significantly on either the nature of the acquisition tasks used in the 
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by subjects with knowledge organizations A or B. (The scores C and C. 
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strong or wait treatments, nor on the subjects' abilities. 

The sumiarles resulting fran the free-recall tasks can be analysed 
(In the fashion described In the; next section) to obtain scores Indicating 
the proportion o' knowledge units recalled at every level of a postulated 
organization. The data consistently Indicate that Information at the 
higher levels ms recalled better than Infonnatlon at the lower levels. 
They also show the expected differential effects of acquired prgintzatfoiT 
on the ability to recall Infonnatlon of different types. For example, 
awng subjects acquiring the A organization with deductive Infonnation 
at Its higher levels, the recall score was 50< for the first or highest 
level, 50? for the second level, 2711 for the third level, and about 51 
for the lowest level Including historical Infonnatlon. (Indeed, only 
3 out of 10 subjects nentlo.'ied historical Infonnatlon at all.) Similarly, 
among subjects acquiring the B organization with historical Infonnatlon at 
Its higher levels, the recall score was 651 for the first or highest 
level, m for the second level, and 4« for the third level containing 
predominantly deductive Infonnatlon. 

In conclusion, even with our small number of subjects, the observed 
differences In perfonnance are consistent and large enough to Indicate 
the Importance of appropriately adapting a hierarchical organization to 
the Intended tasks. Thus no hierarchical organization Is universally 
superior for all tasks, (indeed, as shown In Fig. 6, the overall per- 
fonnance of subjects with A or B organizations Is about equally good on 
the caiblned set of tasks of type a and b.) 




26. 

Ac quisition of organizat ion 

The free-recall sunnarles written by subjects two weeks after the 
treatment were used to make some Inferences about their acquired internal 
knowledge organization. To * this, each sunnary was interpreted as 
being a systematic linear traversal of some underlying internal knowledge 
organization. The analysis consisted then of trying to map this observed 
linear sequence upon the particular organization presumably acquired by 
the subject In the prior treatment (the A organization for a subject In 
the A or A treatments, or the B organization for a subject in the B 
or treatments). To Element this analysis, we sequentially numbered 
the statements in a subject's sunnary, and then attached these numbers to 
the organizational structure presumably acquired by the subject. These 
sequential numbers Indicated then a retrieval path within the sub- 
ject's hypothesized organization. 

Host of the observed paths were indeed consistent with a subject's 
systematic traversal, top-down and In depth, of the particular organiza- 
tion supposedly acquired In the prior treatment. Fig. 7 summarizes the 
data compactly by Indlcatlng^on a simplified A (deductive) organization, 
the "average retrieval path" of all 10 subjects who had read the A ver- 
sion In their treatment. (This average path was obtained by averaging 
the numbers Indicating the serial positions of the knowledge units re- 
called by the Individual subjects.) The retrieval paths can also be 
described in greater detail by specifying the observed de viations of the 
paths from a top-down path. (This can be done by simply computing the 
proportion of subordinate units refilled before their superordlnate units.) 
Among the 10 subjects who had read the A version, 9 had no such devia- 
tlons^and 1 had Ki such deviations. Among the subjects who had read the 
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flgj: A siiplifled A organization with numbers showing the average 
retrieval path of the ten A and A subjects. 

9 W 



B version, 6 had no such deviations, 1 had 33X deviations, 1 had Hi 
deviations, 1 completely reorganized the infomiation into tlie A organi- 
zation, and 1 completely misinterpreted the infomiation.'^' 

The preceding results indicate that our treatment methods were 
quite effective in inducing subjects to incorporate the presented organi- 
zation. These results are consistent with some previous work by 
Shavelson (1973) whose experiments showed a good correspondence between 
the organization of instructional materials ("content structures") and 
the resulting organization of well-Internalized knowledge ("cognitive 
structures"). 

Effects of different acquisition tasks 

The overall performance of subjects in the "strong" treatments was 
significantly better than that of subjects in the "weak" treatments, In 
particular, a two-way analysis of variance (input version x acquisition 
tasks), perfomied on the Sim of the composite scores of all a and b tasks, 
showed explicitly that the different acquisition tasks had significant 
effects [F(l,12)' 5.96, p< 0.05]. 

These results indicate that appropriate acquisition tasks are im- 
portant for assuring that a particular knowledge organization is inter- 
nalized. In our experiments, those subjects who had engaged in acquisi- 
tion taslis explicating the organization through a visual representation 
perfomied better than those subjects who had merely been asked to write 
a well-structured sumiary. This performance difference existed despite 
the fact that all subjects had studied the same well-organized written 
siaterlals and had devoted equal tine to acquiring the organization. 
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imim 3 

The purpose of experiment 3 ms to study In greater detail the 
process thereby an Internal organization Is acquired. This experiment 
used the same materials as those of experiment 2. The acquisition tasks 
were also similar, but with some Important modifications. Thus the 
experiment dealt with subjects Individually to carry out the acquisition 
process under more controlled conditions, Furthennore, the final per- 
fonnance of Individual subjects was observed more unobtrusively and ^as 
then subjected to more detailed analysis. 

HETIIOD 

The A and B treatments used In this experiment were similar to the 
strong A and B treatments in experiment I (See Fig. 5 J They used 
the same materials and Mere designed to have subjects acquire either the 
A (deductive) or B (historical) organization. HoMever each treatment, 
lasting about 90 minutes, was carried out with Individual subjects. 
Correspontilngly, one could monitor more closely that each subject read 
the materials and carried out the acquisition tasks In the prescribed 
sequence, and could also provide subjects with oral corrective feedback 
on their acquisition tasks. 

After the treatment, each subject was told to come back after two weeks 
to engage In slBlUr activities. Hhen the subject returned, he (or she) 
was asked to tell orally everything he could remember about what he had 
learned In the first session. (This "free-recall" task, unlike that In 
experiment 2, was completely unstructured and did not provide the subject 
with any Instructions abdut the manner of retrieving the Information.) 
The subject's recall was then tape-recorded and subsequently transcribed 



Into the form of a protocol. 

The eight subjects participating In this experiment were paid volun- 
teers obtained among students In ai; Introductory college-level physics 
course. These subjects were matched Into pairs of comparable ability on 
the basis of their prior perfonnance In their physics course. The two 
members of each pair were then randomly assigned to the two treatments. 

RESULTS 

The oral-recall protocols were analyzed In a manner similar to that 
used for analyzing the recall sunnarles In experiment I The analysis 
of each subject's protocol led thus to a retrieval path within the sub- 
ject's presuned Internal knowledge organization. The detailed analysis 
and soiiie case studies are described In Eylon (1979). Here we only 
sumarlze the major results without detailing the evidence: 

(1) The Internal knowledge organization. Inferred from the proto- 
cols, corresponded well to the organization presented in each subject's 
treatment. Indeed, six out of the eight protocols could be mapped Into 
a systematic top-down retrieval path within the appropriate Input 
organization, 

(2) Subjects recalled the Information In different orders," Thus, of 
the subjects using tup-down retrieval, some traversed the hierarchical 
organization In breadth, some In depth, and some used a combination of* 
both procedures. This variety of traversals Indicates that subjects did 
!iot merely recall the Infoiiatlon In the sequence in which It was original- 
ly presented. Instead, thiy extracted an underlying structure which they 
subsequently traversed according to their own preference. Thus the under- 
lying knowledge organization is more fundamental than the sequential 
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procedure of presenting or using this knowledge, 

(3) Higher levels of the hierarchical organization were usually 
recalled better than lower levels. For example, in the deductive 
organization, the average proportion of knowledge units recalled was 63t 
fron the first or highest level, 451 from the second level, and 9! from 
the third level. Similarly, in the historical organization, the average 
proportion recalled was 751 fron the first level, 36t from the second 
level, and 43} from the third level, (When subjects were prompted to 
provide more information, they added mostly infonnation from the lower 
levels.) 

(4) The retrieval paths of two subjects could not be mapped upon 
the organization of their treatment. These subjects recalled very little 
infomation and also did not seen to exhibit any appreciable organiza- 
tion of their underlying knowledge. These two subjects were also the two 
subjects of lowest ability (as determined by performance in their physics 
class). This correlation of performance with ability was also more 
generally apparent. Thus the four subjects of highest ability recalled 
on the average about Hi of all the knowledge units, while the four 
subjects of lowest ability recalled on the average only about 20J of all 
these knowledge units. 

DlSCUSSIf 

WIN COWCiySIOHS 

This study formulated a particular prescriptive model of a useful 
internal knowledge organization and tested selected aspects of this 
Bodel under controlled experimental conditions. The main conclusions 
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emerging from this work are the following; 

(1) An internal knowledge organization, which describes informa- 
tion hierarchically at several levels and is appropriately adapted to 
the Intended task domain, can appreciably enhance a person's perfomance 
on recall and problem-solving tasks. Performance is facilitated most for 
tasks utilizing infonnation at the highest levels of the hierarchical 
organization. 

(2) By using sufficiently controlled experimental conditions, it 
1s possible to induce a person to acquire a specified fonn of internal 
knowledge organization. Weaker experinental conditions are partially 
effective. (However, our experiments did not seek to determine optimally 
efficient procedures for promoting the acquisition of given forms of 
internal knowledge.) 

(3) The persons studied ii; our experiments exhibited individual 
differences on task performance, differences which correlated positively 
with prior performance in a physics course. Experiments 2 and 3 suggest 
that some of these differences were due to differing abilities to acquire 
a given hierarchical knowledge organization; experiment 1 suggests thit 
some of these differences were also due to differing abilities to re- 
organize acquired information. 

IHPLiCATlOliS 

The work discussed in this paper has also some implications beyond 
the preceding specific findings. From the point of view of research on 
human information processing, the work points out the interest of studying 
the effects of knowledge organization on various problem-solving tasks 
more complex than recall tasks. Furthermore, it suggests some specific 
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nethods for Inducing specified fomj of Internal knowledge and for ob- 
taining evldenre about the nature of such knowledge. 

FriM a broader perspective, the work Illustrates the utility of an 
approach which strives to formulate prescriptive Information-processing 
models for enhancing human performance. The effectiveness of such 
models can then be studied In experiments where human subjects are 
deliberately induced to act In accordance with the models. IThe virtues 
of such an approach are discussed In (Relf, 1979).) Such an approach can 
be useful for research purposes since It allows one to study selected 
jspects of a model under well-controlled manlpulable conditions. Further- 
more, the approach can be usefully extended to design Instruction by 
combining well-valldated prescriptive models of human nerformance with 
specific Instructional models. 

From the point of view of practical education, our work Indicates 
that the organization of the knowledge acquired by a student, and not 
Just Us content, 1$ of crucial Importance In deteralnlng the student's 
ability to use this knowledge effectively. Pragmatic Instructional ef- 
forts could thus benefit significantly by paying more attention to the 
organization of knowledge to be taught. Our work Indicates specifically 
that a hierarchical task-adapted knowledge organization can be broadly 
useful for facilitating many recall and problem-solving tasks. Further- 
more, our work suggests how useful ly-organlzed knowledge can be taught by 
suitably structured teaching materials (e.g., containing explicit Indica- 
tions of hierarchical multi-level organization, explicit connections 
between levels of description, systematic order of traversal of the 
hierarchy) and by carefully designed teaching methods (e.g., using active 
student processing for Incorporating organizational aspects). 
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LIHITATIQNS m EXTENSIONS 

Several aspects of the model of hierarchical knowledge organization 
have not been studied In our work and might usefully be explored. For 
example, can one specify an optimum amount of Infomwtion per knowledge 
unit? Or how might different levels of description profit by using 
appropriately different symbolic representations? 

It would also be of Interest to extend our prescriptive approach 
to study the effectiveness of a hierarchical knowledge organization for 
larger and more complex knowledge domains (e.g., for the solution of 
problems In physics). 

We dealt with the acquisition process merely to assure that a 
specified ion of internal knowledge Is actually acquired. However, the 
Input process by which a person acquires various foras of Internal know- 
ledge Is worthy of study In its own right. For example, how can a linear 
sequential Input process (such as reading prose) efficiently convey the 
Infonnatlon necessary :o construct a complex multl-dlmensional structure 
of internal knowledge? Such a question might also usefully be studied by 
formulating prescriptive theoretical nwdels of such an acquisition process 
(e.g., models specifying optimal mappings of a hierarchical organization 
upon a linear structure that can be traversed sequentially). Particular 
features of such models could then again be studied under well-controlled 
conditions where the acquisition process Is known to occur In a mnmr 
specified by the iwdel. Studies of this kind would also be directly 
relevant to practlcaVlnstructlon which Is obviously Interested in de- 
signing procedures for pitmotlng the efficient acquisition of Internal 
knowledge. 
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Finally, our work leads naturally to some more far-reaching ques- 
tions. How do individuals acquire the important cognitive skill of 
reorganizing information into more efficient fomis? And, given our 
evidence about the effectiveness of a hierarchical organization, how 
could one teach students the skill of independently organizing infoma- 
tion into such a useful hierarchical form? Such questions deal with an 
interesting cognitive processing sklll^and are also directly germane to 
the central educational aln of making persons better independent learners, 
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FQOTtlOTES 

(1) A fuller discussion of this model, and of tiis experiments described 
in this paper, can be found in an unpublished thesis by Eylon (1979). 
Some copies of this thesis can be obtained, at cost, from the author. 

(2) The structure in Fig. I is thus a network or graph, rather than a 
simple tree, It may also be useful to characterize the knowledge 
units In Fig. 1 by distinct levels of Importance (so that retrieval 
can be pursued only down to a particular level). Then it is ad- 
missible that elaboration of, two knowledge units at the same level 
(such as C and D in Fig. 1) may lead to knowledge units at different 
levels of importance. 

(3) Throughout experiment Z, subjects performed relatively worse on 
historical tasks and seemed to incorporate the historical orpiza- 
tion less well. One possible reason may be the prior mental set 
whereby subjects, used to studying physics, are Inclined to ignore 
historical information. 

(4) Indeed, the utility of such ideas has been successfully exploited 
In the design and Implementation of practical physics laboratory 
Instruction (Relf and St. John, 1979). 
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